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This paper summarizes a comprehensive study of three predictors used for compensating 
the transport delay in a flight simulator; The McFarland, Adaptive and State Space 
Predictors. The paper presents proof that the stochastic approximation algorithm can 
achieve the best compensation among all four adaptive predictors, and intensively 
investigates the relationship between the state space predictor’s compensation quality and its 
reference model. Piloted simulation tests show that the adaptive predictor and state space 
predictor can achieve better compensation of transport delay than the McFarland predictor. 
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I. Introduction 

I N the AIAA conference paper “New Predictive Filters for Compensating the Transport Delay on a Flight 
Simulator” published in 2004 (AIAA-5441 (2004)', two novel predictors for compensating the transport delay in a 
flight simulator were introduced: the adaptive predictor and the state space predictor. The adaptive predictor makes 
use of the Kalman filter algorithm in a unique manner so that the predictor can provide the desired amount of 
prediction, significantly reducing the large spikes in the response, caused by the McFarland predictor. It also 
presents three simplified Kalman filter algorithms, i.e., the Karzmarz algorithm, the stochastic approximation 
algorithm, and the least mean squares algorithm. For the convenience of comparison with the McFarland 
compensator 2 , three consecutive steps of velocity are employed in the predictors. Therefore, the adaptive predictors 
and the McFarland predictor share the same structural expression; 

y P ( k ) = y( k ) + b o v ( k ) + b i v ( k ~ l) + b 2 v(k-2) (1) 

where y is the aircraft state to be predicted, v is the corresponding velocity, y p is the predicted aircraft state, k is 

the iteration index. Different means of determining the coefficients^, b x and /?, define the predictor types. The 

McFarland predictor coefficients are designed with sinusoidal tuning, and remain constant throughout the whole 
simulation. In contrast to the McFarland predictor, the adaptive predictors update the coefficients during each frame. 

If 0(k) = \jb 0 (k) b x (k) A, (k)] r and j r (k) = [v(k) v(k-l) v(k- 2)] , then all four adaptive predictors can be 

expressed in a general mathematical expression; 

e(k) = e(k-i)+^[j(k)-^(k)-j r (k)e(k-i)] (2) 

£ k 

Table 1. Expression of s k in Eq. (2) for several where for different adaptive predictors, the only 

difference lies in the expression for s k . Table 1 lists the 
expressions for s k for several adaptive predictors. Note 
the difference between the basic Kalman filter (2 nd row), 
in which s k represents a square matrix, and the 
stochastic approximation algorithms (5 th row), which 
s k represents a scalar. Notice also that this term 
becomes a constant for the least mean square algorithm. 

With some examples, the paper AIAA-5441 (2004) 
shows that the adaptive predictors can significantly 
reduce the large spikes caused by the McFarland 
compensator, and the stochastic approximation 
algorithm achieves the best compensation among all 
adaptive algorithms. However, the paper did not 
investigate the underlying causes of the results. In the 
next section, this paper analyzes how the McFarland 
compensator produces large spikes, how the adaptive predictors mitigates these spikes, and finally presents a 
mathematical explanation for why the stochastic approximation algorithm works better than other adaptive 
predictors in compensating the transport delay by using its asymptotic ODE. 

The second novel predictor is the state space predictor that is, loosely speaking, an application of the 
Sobiski/Cardullo 3 4 compensator in a flight simulator using a linear, time-invariant aircraft model called a reference 
model. The Sobiski/Cardullo predictor is given by 

x (f + = O x (f) + < PBi/(f) . (3) 

where (|> = e A '“ and *p = f I] di are the state transition matrix and its integral matrix, where A is the state 

Jo 

matrix of a linear system. A linear reference model is used to implement the Sobiski/Cardullo predictor when the 
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system dynamics are not linear, and for such a situation, the matrix A is the state matrix of the reference model. 
Assume a 4 lh -order reference model has the following typical form: 

h ac ( s )= 4 A f 2+A r y? ° — , (4) 

^ + a 2 s + cc 2 s +a x s + a Q 

then the state space predictor can be simplified to ([1]) 

y p — (011 012^3 ^ 13 *% ) y (^12 ^ 13^3 ) T ((^1 — ) M + ^4/^0 ) ( 5 ) 

in which T is the frame length, and the (zf and t// . are elements of matrices ® and T , which are functions of the 
a ' s & ft ' s . Therefore, the coefficients of the five terms on the right side of Eq. (5) are closely related to the 
reference model. In other words, the quality of prediction of the state space predictor is determined by the choice of 
the reference model. This paper also investigates the relationship between the prediction quality of a state space 
compensator and the reference model it uses. 

II. Analyses of the Adaptive Predictor 

The biggest problem with the McFarland filter is the large spikes it produces. These spikes, stimulated by high 
frequency dynamics, are observable by the pilot in the visual scene. The longer the delay, the larger the magnitude 
of the spikes. The McFarland algorithm is a special integrator or an extrapolator. The simplest extrapolator to 
provide a prediction of t d is 


y P (k) = y(k) + t d v(k) (6) 

If the velocity changes slowly (low frequency), this extrapolator works well, but if the velocity changes quickly, 
the prediction introduces error because the velocity may be quite different t d later. The McFarland filter is superior 

to the extrapolator given by Eq. (6) because it uses three consecutive steps of velocity that can extrapolate the future 
position better than a single velocity. Furthermore, the sinusoidal tuning of the coefficients contributes to the 
superiority of the McFarland compensator over others. For moderate frequencies (around 1 Hz), let the average of 
these three velocities be V , then Eq. (1) reduces 

to y p [k) = y[k) + t cl v(k) , which is similar to Table 2. Several iterations of McFarland prediction with 

Eq.(6), but the average velocity is used, resulting in 
a better prediction. Therefore, its working 

frequency range is wider than the simplest 
extrapolator given in Eq. (6). However, spikes 
occur if the velocity changes rapidly (the frequency 
is higher). No matter what the delay is, the three 
coefficients b 0 , p and b 2 are always positive, 
negative and positive, respectively, and the absolute 
value of p is always the largest, e.g., for t d = 0.2s, 
b 0 =2.9979, p =-5.5197 and b 2 =2.7219. The 
absolute values of them are at least 10 times greater 
than^ . If the velocity changes by more than 10% 

in several iterations, spikes in the predicted value 
are likely to occur. Table 2 gives an example, where 
the two spikes are highlighted in orange color. 

From this example, the spikes in the McFarland compensation are caused by: first, the three coefficients change sign 

2 

alternatively, and with alternative sign changes, the greater the sum ^ | b i I = \b 0 1 + \p I + \p | is, the more likely the 

;= o 


t 

(s) 

(rad/s) 

v i 

(rad/s) 

V 2 

(rad/s) 

y? 

(rad) 

59.776 

0.1000 

0.1015 

0.1029 

0.0115 

59.792 

0.0877 

0.1000 

0.1015 

-0.02 

59.808 

0.0754 

0.0877 

0.1000 

0.0085 

59.824 

0.0630 

0.0754 

0.0877 

0.0072 

59.840 

0.0507 

0.0630 

0.0754 

0.0056 

59.856 

0.0504 

0.0507 

0.0630 

0.0402 

59.872 

0.0502 

0.0504 

0.0507 

0.0080 
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equation to generate spikes; secondly, the coefficients do not change with respect to the simulation conditions. One 
better choice for the three coefficients would be b 0 =b l =b 2 = t d / 3. If, however, the coefficients are made to vary 
with the simulation conditions around t d /3 , the prediction will be even better. 

Although the adaptive predictors cannot guarantee non-alternative sign changes, they indeed significantly reduce 

2 

the sum ^ | b j | = \b 0 | + |&, | + |Z>, | , and make the coefficients adaptable to the velocity changes. These are the two main 

i= 0 

reasons the adaptive predictors reduce the spikes, and cause smaller gain error than the McFarland predictor, 
especially for long time delay. While the adaptive predictors minimize the root mean squared gain error in every 
iteration, the coefficients are adjusted to some optimal pattern, so that even in the case of large velocity changes, 
such as the two cases shown in Table 2, spikes are 

less likely to occur. Table 3. The three coefficients calculated with different 

The fact that the adaptive predictors can methods {t d =192ms) 

2 

significantly reduce the sum ^ |Z>. | = \b 0 1 + |Z>, | + \b 2 1 

1=0 

is illustrated in Table 3, which was obtained by 
averaging the converged coefficients across 16 
offline tests for all adaptive predictors. This sum is 
about 10 times larger for the McFarland predictor 
than for the basic Kalman predictor, which is still 
considerably greater than the stochastic 
approximation algorithms and the least mean 
algorithm. The basic Kalman filter and the 
Karzmarz algorithms still result in alternative 
coefficient sign changes. Although the least mean 
square algorithm gives all-positive coefficients in 
this table, but it has been demonstrated in other 
simulations that the coefficients of the least mean square algorithm have alternative sign changes. Only the 
stochastic approximation algorithm guarantees non-alternative sign changes of the coefficients, and hence produces 
2 

the smallest sum ^ \b, \ , and the coefficients are closer to t d /3 than other adaptive predictors. This may be shown 

/= o 

mathematically as follows. For convenience, the expression of the stochastic approximation used in the final piloted 
tests is given in Eq. (7) 


Algorithm 

K 

bi 

b 2 

Sum 

»l 

1=0 

McFarland 

Filter 

2.8613 

-5.2342 

2.5650 

0.192 

10.660 

5 

Kalman 

Filter 

-0.0030 

-0.5894 

0.7811 

0.189 

1.3735 

Stochastic 

Approximation 

0.0525 

0.0571 

0.0789 

0.188 

0.188 

Karzmarz 
; Algorithm 

-0.2064 

0.0503 

0.3485 

0.192 

0.6052 

Least Mean 
Square 

0.0284 

0.0700 

0.1066 

0.205 

0.205 


e(*) = e(*-i) +nr -^ — [ y (k)-y d {k)-i T {k)*{k-\)\ (7) 

Zf (0i(0 

/=t„ 

k 

which was obtained by replacing e k in Eq. (2) with ^ j 7 ( f ) j ( f ) . This is just one version of a large family of 

>'=* 0 

stochastic approximation algorithms. Two other commonly used versions are the Saridis and Stein’s algorithm and 
the Kwatny’s form 4 5 . Robins and Monro have shown that the general Kalman filter algorithm given in Eq. (2) is a 
stochastic approximation algorithm if 


1 “ i ^ 

s k >0, lim — = 0, ^ — = oo, and < < 


t=i t. k 


t-=i t. k 


( 8 ) 


Eq. (8) also gives the conditions of algorithm convergence. Under normal circumstances, the velocity in a flight 

k 

simulation does not change exponentially, and therefore the parameter e k = ^ j r (i) j(i) in Eq. (7) satisfies Eq. (8), 

i=k„ 

and hence the algorithm of Eq. (7) is indeed a stochastic approximation algorithm. On the other hand, in the 
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Karzmarz’s algorithm s k = ^ j 7 ( / ) j ( / ) , and in the least mean square algorithm s k is a constant, both of which do 


not meet the lim — = 0 requirement. Therefore, they are not stochastic approximation algorithms. 

k — >oo f 
b k 

The ODE that characterizes the asymptotic behavior of the stochastic approximation algorithm is 6 given in Eq. (9) 

0 = --—E{\y-yA- fe} 2 

2 50 U di 1 (9) 

0 = £(jf)-£(yf)e 


where “ E ” is the mathematical expectation. The right side of the first equality of Eq. (9) is the negative gradient of 
the cost function, indicating that the stochastic approximation algorithm may be interpreted as a “stochastic” 

1 ,2 

gradient descent algorithm. Though the gradient of the cost function I = — E\y — y c ] ( y c is the compensated y) 

with respect to 0 is unknown, the gradient at the current sample of -§_y(k)-y d (£)]- j r (^r) © — l)} is 
just i{k)\y(k)-y d (k)- j r (&)0(&-l)l , the dynamic term in Eq. (7). Because the quantity inside the brackets 


y(k)-y d (&)- j r (£)0(£-l) is a scalar, from the asymptotic ODE, 0(£) is in the direction of j(A). This means 
that the modifying term of 0(£ + l) is in the direction of j(A). And since the recursive algorithm starts with an 
initial zero vector, it is logical that 0 is in a direction close to the average of j . Because 
j r (£) = [v(£) v(£-l) v{k — 2)1 , the average velocity does not change much within two iterations, and the three 

elements of 0 (or the coefficients of the adaptive predictor) do not differ much. This demonstrates why the 
stochastic approximation algorithm gives the best prediction. 


III. Analyses of the State Space Predictor 

For all four 4 ,h -order aircraft reference models that were applied to the state space compensator, the last two 
terms in Eq. (5) are very small compared with the first three terms, which come from the first term of Eq. (3). This 
shows that, in the state space compensation governed by Eq. (3), the second term contributes little to the prediction. 
In other words, the first term including the state transition matrix dominates the compensation. The state transition 
matrix plays a critical role in the predictive algorithm. By definition, the state transition matrix can be expressed as a 
Taylor series expansion 


q> = e *‘=f&L. (10) 

i=o i ■ 

In this sense, the state space compensation may be viewed as a Taylor series extrapolation in the state space form. 

Because this series is always convergent, it is usually approximated by truncating it to a finite series. The 
number of terms necessary to obtain satisfactory approximation depends on the matrix A . For the four 4 th -order 
aircraft reference models, the first five terms are sufficient. Therefore, 

0. = ^ *l + At rf+ i(A^ 2 +i(AtJ 3 + ^(At,) 4 (11) 

In fact, the fifth term in the last equation contributes little to the final result. This can be shown by using of the 
Cayley-Hamilton theorem. For a 4 th -order matrix A , the Cayley-Hamilton theorem states 
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( 12 ) 


q> = e A,J = £a,.A' 

i = 0 

where the coefficients a 0 - or , are the solution of the following coupled linear equations 


(13) 


SMj = exp[Xjt d ), ( j = 0...3) 


with Aj being the eigenvalues of the matrix A , provided that all eigenvalues are distinct. For all four reference 
models, it has been found that 


1 


1 




a, a, ~t d ,a 2 ~-t d ,a 3 «-t d 


(14) 


This illustrates that Eqs. (10) and (11) are almost equivalent, 
with the only difference lying in the fifth term of Eq. (10). 
Using Eq. (10), the coefficients of the five terms in the right 
side of Eq. (5) were derived and are listed in Table 4. 
Investigation of all state space predictors shows that for 
correct prediction, the coefficient of the proportional term 
must be either unity or close to unity, the coefficient of the 
derivative term is equal to or very close to the time delay, 
and all other coefficients are much smaller. From Table 4, 
a, must be smaller than an upper limit that varies with the 
amount of time delay to be compensated, in order for the 
coefficient c 0 to be close to unity. Usually a, must be 
small, especially for a long time delay. For the same reason, 
a, also must be fairly small to make the coefficient c 0 
close to the time delay t d . 

The restrictions on a \ and a 2 indicate that there must 
also be some restrictions on the eigenvalues of the reference 
model. For a 4 th -order model, the following relationships 
between the four eigenvalues A 0 - A 3 and a, , a 2 are held 


Table 4. Approximate expressions of the 
coefficients of the simplified state space predictor 
with a 4 th -order reference model 


Coefficient 

Expression 

c 0 

i C\ t — ci Q + 4 

6" 24 4 

Cl 

, a 2 ^3 | ^4 

d 6 d 24 d 

C 2 

1 2 

1 o a~> t. d-> a o 4 

3 1 + 3 2 t 

2 d 6 d 24 d 

c 3 

(a, 3 a, 4 V b n 4 

— d — H/ b i +—t d 
{6 d 24 d J 2 24 d 

C 4 

(\ n \ 

- t 3 -^t 4 b 
16 24 ) 


J A 0 A\ + A l A 1 + A-,A 3 + AqAj + A^A^ + A 0 A 2 — ci 1 

(TqTj/I-, + A 3 A-,A 3 + AqA^A 3 -h AqA-jAj = — 


(15) 


For a stable model, all eigenvalues must have negative real parts. Because all eigenvalues have the same sign, Eq. 
(14) means 


W^AUa^i^j) 

' | , , (16) 

It shows the eigenvalues of the reference model must be smaller than some upper limits in order for the state space 
predictor to function properly. Because the eigenvalues of a model are closely related to its bandwidth, the 
bandwidth may also meet some conditions. This can be verified by gradually varying the bandwidth of a reference 
model and see how the state space compensation is affected. Fig. 1 shows the results. Investigation reveals that 
satisfactory compensation in simulating the Boeing 757 can be achieve when the bandwidth is below 1 rad/s. The 
reference model bandwidth plays a major role in the compensation quality of the state space predictor. 
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A similar study of variations in the 
damping ratio was completed in a manner 
similar to varying the bandwidth. This study 
shows that the damping ratio of the reference 
model does not make a significant difference 
in the state space compensation. 

The order of the reference model also 
affects the state space compensation. To 
demonstrate that, 3 ld -order and 4 th -order 
reference models were compared first. In 
order to accomplish this, a 3 rd -order model 
was formed by reducing a 4 th -order model in 
a manner such that the reduced-order model 
shares similar frequency characteristics with 
the original model. Then both models were 
used in the state space compensation. The 
result shows that the compensation error is 
considerably greater with the 3 ld -order model 
than with its 4 th -order counterpart. This 
agrees with the results of the offline 
simulation tests presented in AIAA 
5441(2004)'. 

A 2 nd -order reference model results in 
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State Space Compensation Using Model B with Varying Bandwidth 
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Fig. 1. State space compensation using model B with varying 
bandwidth 


even poorer compensation quality than a 3 rd -order model. With a 2 nd -order model, the simplified state space filter is 

i 

given as y p = a 0 y + a, y + (l - a 0 ) u , where a 0 and a t are solutions of equations ^ , (y = 0, l) , with A 0 and 


Aj being the two eigenvalues of the model. The compensation is inferior to that of the state space compensation 
with a 4 "'-order model (Eq.(5)) because less system information is used for prediction. 

Finally, if a 5 th -oder or higher reference model is employed, the filter state vector contains either a higher 
frequency jerk component (derivative of acceleration) or triple integration of the aircraft state, which is likely to 
introduce computational artifacts. Therefore, the 4 th -order reference model is the best choice for this situation. 

The gain of a reference model also influences the compensation quality. From Table 4, the coefficient c 3 is a 


function of the gain of the model (i.e., b 2 ). The large gain of the reference model amplifies the high frequency 
components in the control input u, but the effect is negligible since the 4 th term (with coefficient c 3 ) contributes little 
to the compensation. In addition, the sensitivity of a reference model’s compensation quality to the variation of its 
gain depends on the individual model: some models are more sensitive than others. In other words, the effect of the 
gain of a reference model is much less significant than its bandwidth. 

In summary, the following points are the conclusions of this study on the state space predictor, and the relations 
between the compensation quality and the reference model: 

1) The state space predictor can be simplified to a general PID filter 1 . 

2) The state space compensation may be viewed as a Taylor series extrapolation in the state space form. 

3) Satisfactory compensation in simulating the Boeing 757 can be made when the bandwidth is below 1 rad/s. 
The reference model bandwidth plays a major role in the compensation quality of the state space predictor. 

4) The damping ratio of the reference model does not make a significant difference in the state space 
compensation. 

5) The 4 "'-order reference model is the best choice for this situation. 

6) The effect of the gain of a reference model is much less significant than its bandwidth. 


IV. Transport Delay Measurement 

A series of tests were conducted to measure the transport delays in the Visual Motion Simulator (VMS) at the 
NASA Langley Research Center, using a device called SIMES 7 (the SIMulator Evaluation System). Developed by 
SAIC for the Naval Air Warfare Center Training Systems Division, in cooperation with the Wright-Patterson Air 
Force Base, SIMES is a comprehensive, non-intrusive, accurate and reliable system to test, debug, and document the 
cueing systems and dynamic models of various kinds of simulators. SIMES also can generate control signal in place 
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of the operator to run unmanned tests. Thus the Table 5. The three coefficients calculated with different 
SIMES provides a combination of the functions of me tj,ods =192ms) 
the control loader, logical analyzer and video level d 

detector. It can generate and send sinusoidal signals 
and sweep signals to the simulator, and collect 
responses from it. Unfortunately the SIMES unit is 
not capable of frequency response analysis (it’s not a 
FRA). Figure 2 shows where the SIMES-generated 
input was added as well as where various data were 
collected on the VMS. The control signal was 
inserted either at point A, so that the aircraft states 
were input to the cueing systems directly from the 
SIMES (Scenario I), or at point B, so that the aircraft 
states were provided by the EOM. In the latter case 
the aircraft model was either in use (Scenario III) or 
bypassed by replacing it with a constant gain K 
(Scenario II). The SIMES generated input and 
collected the data (except those EVDAS visual 
signals) at the speed of 1000 Hz; the mainframe 
computer update frequency was 40 Hz, and the 
visual computers ran at a rate of 60 Hz. Therefore, 
some asynchronous communication delays exist. 

The EVDAS signals were recorded at 60 Hz. 

The numbers in Fig. 2 indicate the points at 
which the data were collected from the VMS by the 
SIMES, and they are tabulated in Table 5. 

Specifically, the five EVDAS signals were obtained in the visual system and were used to measure the visual system 
transport delay; a photodiode was used to measure the instrument system transport delay; signals 14-19 were used to 
measure the motion system delay. Points labeled 14-19 are located sequentially in the motion system, as depicted in 
the lower half of Fig. 2. 

The leg positions (labeled 19) were 
measured with potentiometers, and were 
then transformed to the position and the 
orientations of the payload platform using 
a recursive inverse Newton-Raphson 
transformation. The transformed position 
and orientations were then used to 
determine the delay of the motion system. 

In addition, six accelerometers mounted on 
the payload platform sensed accelerations 
that were transformed to the payload 
platform accelerations in all six DOF’s 

(labeled 20) using kinematic (a) 

transformation. The motion system 
transport delay was also measured from 
the leg positions sensed by the 

potentiometers. Because the potentiometer 
caused larger error than the accelerometer, 
the final measure result of the motion 
system delay was from the accelerometer 
data. A 2 nd -order filter was applied to the 

accelerometer data to reduce the 

measuring noise caused by the 

accelerometers (labeled 21). 



(b) 
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No. 

Name 

1 

Control Device Position Over Drive 

2 

Control Device Position 

3 

Accelerations 

4,5,6 

Rates, Attitudes, Pilot Eye Point 

7-11 

EVDAS Signals 

12 

Attitude Indicator 

13 

Photo Diode 

14,15 

Attitude& Rate Motion Commands 

16 

Leg Drive Commands 

17 

Simulator Leg Commands 

18 

Accelerometers 

19 

Leg Positions 

20 

Accelerations from the Accelerometers 

21 

Filtered Values of 20 


A. Scenario I 


Fig. 2. Signal flow diagram of the delay measurement in the VMS 

8 


American Institute of Aeronautics and Astronautics 


For scenario I, because both the aircraft model Table 6. Transport delays in the three cueing channels 
and the EOM were skipped, the output signals of 
the visual system and the instrument system 
resemble the input. The measurement of the visual 
delay is based on the EVDAS Y2 signal. The 
transport delay in the two cue channels were 
obtained as the average of the delays determined 
from the 10 transition points, and were further averaged across the five test runs conducted. The result is given in 
Table 6. 

The delay is 58 ms in the visual channel and 40 ms in the instrument channel, with a cueing mismatch of 16 ms. 
In this test, the sampling latencies in the two channels were 14 and 12 ms, both of which are less than one frame 
(16.7 ms). They are not counted because the sampling latency behaves as communication asynchrony, which will be 
addressed later. The theoretical average time delay in the visual is 3.5 frames, that is, 58.4 ms if the update cycle of 
the visual system is 16.7 ms. Therefore, the measuring error for the visual delay is small. 

The input signal used to measure the delay in the motion system was either a step or a doublet. The terminal 
responses of the motion system were sensed using accelerometers (for the platform accelerations) and 
potentiometers (for leg positions). The accelerometer readings were favored due to the large potentiometer latency. 
Because of the measuring noise in the accelerometers, the data were filtered before determining delays from them. 
Both the raw and filtered data were employed to determine the delay. The transport delays in the motion system 
alone with both step input and doublet input are averaged to be 56 ms (Table 6). Again, a sampling latency of 10 ms 
is not included. 

B. Scenario II and III 

In both scenarios, the SIMES input 
signal was injected at point B (Fig. 1), 
and the difference is whether the 
aircraft model was skipped (scenario 
II) or in use. In both cases, the onset of 
the response was difficult to identify. 

Therefore, a least squares curve fit 
was employed to fit different time 
segments of the responses so that the intersections of the fitting curves were treated as the starting point 
corresponding to the onset of the input. Doublet signals with varied duration were used as input signals. The total 
transport delays from the aircraft control input to the motion terminal and visual terminal, including the sampling 
uncertainty and the asynchrony, are given in Table 7. All dynamic model processes, EOM integrations and various 
coordinate transformations are completed in a single frame, and the delay of most intermediate variables can be 
determined with small errors. Processing of the aerodynamic model only consumes 7 ms of a frame. 

C. Summary 

Notice that the values in the Table 7 are averages with large variances due to the difficulty of determining the 
onset of the response and the measurement noise. It suggests that measuring the total transport delay as was done in 
scenarios II and III is not a good solution. This assertion is confirmed by the fact that the frame length of the 
simulation mainframe computer may be altered occasionally, depending on the aircraft model and simulation task 
(More complex aircraft models may require longer a frame time). This means that the total transport delay measured 
in one situation does not necessarily apply to another. Fortunately, this problem may be solved given that: 1) the 
visual system computer’s frame is fixed to 16.7 ms, and the delays in the individual cueing channels can be 
measured accurately; 2) the delays associated with the aircraft states from the aerodynamics and the EOM can be 
determined with high accuracies. Therefore, a good measure of the total transport delay can be obtained using two 
steps: first, measure the individual cueing subsystem delay as in scenario I, and second, calculate the total delay with 

t d =\.5T m +t a +t e (17) 

where T m is the frame cycle of the mainframe computer, t a the average asynchronous delay, and t c the transport 
delay in a cueing channel. On the average it takes half a frame for a control input change to be sensed by the 


Table 7. Transport delay in the three basic channels 


Aerodynamics 

Skipped? 

Delay (ms) 

Motion 

Visual 

Yes (Scenario II) 

88 

106 

No (Scenario III) 

101 

132 


Cue Channels 

Visual 

Visual 

Motion 

Instmment 

Delay (ms) 

58 

56 

40 
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mainframe computer (this is known as sampling latency), and one frame to complete the aerodynamics and the 
EOM, so that the total average delay in updating the aircraft states is 1.5 T m . t a may be calculated with Eq. (18). 


t a (m) = T 


f M 
1 N 



(18) 


where rn is the iteration index of the visual computer, T is the update period of the host computer, and M/N is the 
minimal fraction equal to the ratio of T'/T ( T' is the update period of the visual computer), or M and N must be 
relatively prime 8 . For this measurement, T m is 25 ms, and the for the final piloted tests, it was set to 16 ms. The 
values of all three terms in Eq. (17), the maximums and minimums, if any, and the total delays in the three basic 
cueing channels for these two mainframe computer frames are summarized in Table 8. 

Therefore, the average total delay (baseline delay) in the visual channel in the final tests will be 90 ms 
(approximation of 89.7 ms highlighted in red). 


Table 8. Time delays of different sources and the total delays 


Main 


Delay (ms) 

frame 

(ms) 

Cue 

L 

ta 

t c 

Total t d 


Max 

Ave. 

Min 

Max 

Ave. 

Min 

Max 

Ave. 

Min 


Visual 







58 

124.7 

103.8 

93 

25 

Motion 

50 

37.5 

25 

16.7 

8.3 

0 

56 

122.7 

101.8 

91 


Instrument 







40 

106.7 

85.8 

75 


Visual 







58 

105.3 

89.7 

84 

16 

Motion 

32 

24 

16 

15.3 

7.7 

0 

56 

103.3 

87.7 

82 


Instrument 







40 

87.3 

71.7 

66 


V. Results of Final Piloted Tests 

The purpose of the piloted tests was to assess the effectiveness of the two novel predictors along with the 
McFarland compensator, and to compare the results with those of the offline tests that were introduced on AIAA 
5441 (2004)'. In addition to the above three predictors, an expedient algorithm was applied to the McFarland 
predictor in an attempt to reduce the spikes which result from high frequency input. Thus, four distinct compensators 
were tested: McFarland predictor, spike-reduced McFarland predictor, adaptive predictor, and state space predictor. 
For the remainder of this paper, they may be called MF, MFR, AP and SS, respectively. 

A. Test Procedure 

Thirteen subjects with varying aircraft and flight experience flew the NASA Langley Research Center Visual 
Motion Simulator (VMS) running a high fidelity, highly nonlinear mathematical model of a Boeing 757-200. The 
pilots consisted of three NASA simulator engineers, three NASA research pilots, two corporate pilots, one FAA 
pilot, and four commercial pilots. The schedule for each pilot was: on the first day, three hours for training; on the 
second day, six hours for experiment. 

Each pilot executed two flight scenarios — a straight-in approach and an offset approach. Wind was added to the 
straight-in approach, rotating 180 degrees from head on to tail. Turbulence and a gust at the threshold were added to 
the offset approach. Artificial delays of 0, 48, 96 and 192 ms, all integer multiples of the update period (16 ms), 
were inserted into the visual channel in addition to the 90 ms baseline delay, resulting in total delays of 90, 138, 186 
and 282 ms. The added delay will be referred to as “short” delay when it is 0 or 48 ms, or “long” delay when it is 96 
or 192 ms. There were five compensation options: no compensation (NC), MF, MFR, AP and SS. Therefore, in each 
maneuver, there were 20 test runs [4 (delays) by 5 (compensation algorithms)]. Therefore, each pilot ran 40 tests in 
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total. For convenience of statement, the four added delay cases from 0 to 192 ms will be referred to as case I to case 
IV for the straight-in approach, and case V to VIII for the offset approach. 

Four types of analyses of the collected data were completed in order to evaluate the residts. They are: 1) the 
pilots’ performance in minimizing the glide slope error (GSE) and touchdown point error (TDE); 2) the pilots’ 
handling qualities rating from the Cooper-Harper Ratings (CHR) on the glide slope and touchdown; 3) the pilots’ 
workload from the NASA Task Load Index (TLX); and 4) the pilots’ control workload based on the power spectral 
density (PSD) of the simulator control inputs. The first and last assessments are objective evaluations and the mid- 
two are quasi-objective evaluations. In all these metrics, larger value implies poorer simulation performance. The 
succeeding sub-sections treat the analyses and the results of the final tests in this order. The analyses and 
comparisons fall into two categories: 1) compare each compensation case with the no-compensation case; 2) 
compare the MFR, AP and SS with the MF. 

B. Analyses of the Glide Slope Error (GSE) 

In both approach maneuvers, the aircraft, starting from an initial altitude of 1303 ft, descends gradually to 
approach the designated runway for landing. The angle that the aircraft deviates from the ideal glide slope defines 
the glide slope error. The integrated PSD and root mean squared error (RMSE) of the GSE were calculated, and 
because the PSD pf the GSE shows more 
distinction among cases, the analysis is 
based on the PSD of the GSE. The 
integrated PSD is the integration of the PSD 
over the frequency range in which it is 
distributed (it usually is from 0 to 1 Hz). 

Because the 13 pilots revealed large 
variations in the GSE due to the widely 
differing control strategies employed, the 
GSE data from five pilots, i.e., pilots #1,2, 

5, 11 and 12 were selected since they 
resulted in more positive compensation in 
terms of the GSE. Figure 3 shows the mean 
values and standard deviations (STD) of the 
glide slope error of the selected pilots with 
different compensation algorithms. 

Compared with the no-compensation case, 
the McFarland predictor revealed decreased 
mean GSE for six cases (case I, III, IV, V, 

VII & VIII), the MFR revealed decreased 
mean GSE for five cases (case III, IV, V, VI 
& VII), the adaptive predictor revealed 
decreased mean GSE for six cases (case I, IV, V, VI, VII & VIII), and the SS revealed decreased mean GSE for 
seven cases (case I, III, IV, V, VI, VII & VIII). Significant compensation is found for the MFR and AP for case 
VIII. All compensators resulted in better glide slope performance in terms of mean GSE. Compared with the MF, 
the MFR showed lower mean GSE for five cases (case III, IV, VI, VII & VIII), the AP showed lower mean GSE for 
six cases (case II, IV, V, VI, VII & VIII), and the SS showed lower mean GSE for all eight cases. The MFR slightly 
improved McFarland compensation results. Improved effectiveness with the two new novel predictors is apparent. 

C. Analyses of the Touchdown Error (TDE) 

As the aircraft touches down, the difference between the actual aircraft x and y position and the ideal x and y 
position is defined as the touchdown errors. The subjects were instructed to touchdown within the “touchdown box” 
of 1000 x 140 ft 2 . The x touchdown error is defined as the absolute value of the difference between the x 
coordinates of the touchdown point and the center of the box. Because the pilots were instructed to pay more 
attention to the x TDE, only the x TDE is illustrated here. For the remainder of this paper, the TDE only indicates 
the x TDE. The TDE results also were from all 13 pilots. 

Figure 4 shows the mean values and standard deviations of the x touchdown error of the selected pilots with 
different compensation algorithms. Compared with the no-compensation case, the McFarland predictor revealed 
decreased mean TDE for two cases (case IV & VIII), the MFR revealed decreased mean TDE for four cases (case I, 
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Fig. 3. Mean & STD of the glide slope error for pilots #1, 2, 5, 11 
& 12 



12 3 4 

Added Delay (1:0 ms; 2:48 ms; 3:96 ms; 4:192 ms) 


| | No Compensation 

|| McFarland Predictor 
| McFarland Predictor, Spike Reduced 
| | Adaptive Predictor 

State Space Predictor 

- 


tui 

flj 

T@ 


li 

American Institute of Aeronautics and Astronautics 


i I No compensation 
■I McFarland Predictor 

| McFarland Predictor, Spike Reduced 
| 1 Adaptive Predictor 

State Space Predictor 


iWi rtirit ikk hrt 



Added Delay (1:0 ms; 2: 48 ms; 3:96 ms; 4:192 ms) 


Fig. 4. Mean & STD of the TDE for all 13 pilots 


VI, VII & VIII), the adaptive predictor revealed decreased mean TDE for six cases (case I, III, IV, VI, VII & VIII), 
and the SS revealed decreased mean TDE for five cases (case I, III, VI, VII & VIII). The MF resulted in poor 
compensation results, because it increased the 

mean TDE for six cases. The two novel Mean & STD of X-Touchdown Error of All Pilots: Straight-in Approach 

predictors resulted in good compensation. 3000 

Compared with the MF, the MFR showed * 

lower mean TDE for five cases (case I, II, III, £ 2000 

VI & VII), the AP showed lower mean TDE £ 

for seven cases (case I - VII), and the SS § 1000 
showed lower mean TDE for seven cases 2 
(case I, II, III, V, VI, VII & VIII). The MFR 0 

slightly improved the McFarland 

compensation. Improved effectiveness with 
the two new novel predictors is apparent. 

D. Analyses of the Cooper-Harper Rating 
(CHR) 

Two sets of CHR were collected in the 
final piloted tests: the CHR of maintaining the 
glide slope and the CHR of manipulating the 
touchdown point. The difference between the 
two Cooper-Harper ratings reveals no 
considerable difference. Therefore, only the 
CHR on the touchdown is illustrated here. Figure 5 shows the mean values and standard deviations of CHR on the 
touchdown for different compensations in the straight-in approach. As a comparison, the corresponding TDE is 
shown in the lower half of this figure. Compared with the no-compensation case, the McFarland predictor revealed 
decreased mean CHR for six cases (case I, II, III, IV, VI & VII), the MFR revealed decreased mean CHR for five 
cases (case III, IV, VI, VII & VIII), the adaptive predictor revealed decreased mean CHR for four cases (case III, IV, 

VII & VIII), and the SS revealed decreased mean CHR for five cases (case I, III, VI, VII & VIII). There were 
several cases for which some predictors showed equal mean CHR as the no-compensation case: they are case VIII 
for the MF, case VI for the AP, and cases II 

& V for the SS. Compared with the MF, the 
MFR showed lower mean CHR for three 
cases (case III, VII & VIII), the AP showed 
lower mean CHR for three cases (case IV, 

VII & VIII), and the SS showed lower mean 
CHR for six cases (case III - VIII). In terms 
of the CHR, the MF was slightly better in 
compensation than the MFR and AP. 

Improved effectiveness with the SS is fairly 
apparent. Comparing the results of CHR 
with those of TDE and GSE shows that the 
objective performance metrics showed more 
obvious improvement of the two novel 
predictors. 

E. Analyses of the NASA TLX 

The NASA Task Load Index (Hart and 

Staveland in 1988 9 ) is a multi-dimensional 
quasi-objective metric to rate the overall 
workload of the operator in a man-machine 
interaction. The TLX is a weighted average 
of six ratings of six subscales of 
workload 10 : mental demand, physical demand, 
indicates high pilot’s workload. 


Mean and STD of CHR on Towndown with Compensations: Straight-in Approach 
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Figure 6 shows the difference in the mean value and standard deviation of the TLX when using the four types of 
compensators. Compared with the no-compensation case, the McFarland predictor revealed decreased mean TLX 
for four cases (case III, IV V & VII), the 

MFR revealed decreased mean TLX for six Mean Value and STDofthe Weighted TLX of All Pilots: Straight-in Approach 

cases (case I, II, III, IV, VII & VIII), the 
adaptive predictor revealed decreased mean 
TLX for five cases (case III, IV, V, VII & 

VIII), and the SS revealed decreased mean 
TLX for five cases (case II, III, IV, VI & 

VIII). Compared with the MF, the MFR 
showed lower mean TLX for five cases 
(case I, II, III, VII & VIII), the AP showed 
lower mean TLX for five cases (case IV - 
VIII), and the SS showed lower mean TLX 
for five cases (case I, II, III, VI & VIII). The 
MFR, AP and SS showed fairly improved 
the compensation compared with MF. The 
results from the TLX analyses were similar 
to those from the other quasi-objective 
metric, the CHR. 
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Fig. 6. Mean & STD of the TLX changing with compensations 


Mean & STD of the Integrated Roll Stick PSD with Compensations: Straight-in Approach 



F. Analysis on PSD of Pilot Controls 

Smoothed periodogram algorithms were 
used to evaluate the PSD of the pilot 

controls: the roll and pitch sticks, the rudder pedal and the throttle. Integrated PSD were calculated over the interval 
from 0 to 1 Hz because the power outside this range was small for all four controls. The PSD of the throttle showed 
little obvious and consistent changes with the amount of delay and the compensation. Considering the paper length, 
only the integrated roll stick PSD is 
illustrated here. 

Figure 7 shows how the compensators affect 
the mean values and standard deviations of 
the integrated PSD of the roll stick. In the 
following statements in this subsection (F), 

PSD implies PSD of the roll stick. 

Compared with the no-compensation case, 
the McFarland predictor revealed decreased 
mean PSD for five cases (case III, IV, V, 

VII & VIII), the MFR revealed decreased 
mean PSD for six cases (case II, III, IV, V, 

VII & VIII), the adaptive predictor revealed 
decreased mean CHR for six cases (case II, 

III, IV, V, VII & VIII), and the SS revealed 
decreased mean PSD for six cases (case III - 
VIII). Compared with the MF, the MFR 
showed lower mean PSD for four cases 
(case I, II, IV & VI), the AP showed lower 
mean CHR for five cases (case I, II, IV, VI 
& VIII), and the SS showed lower mean 
CHR for six cases (case II, III, IV, V, VI, 

VIII). In terms of the PSD, the MFR 

produced inconsistent comparison results compared to the MF. Improved effectiveness over the MF is considerably 
obvious with the SS, and is fairly obvious with the AP. 



Added Delay (1:0 ms; 2:48 ms; 3:96 ms; 4:192 ms) 

Fig. 7. Mean & STD of the integrated roll stick PSD for all 13 
Pilots 


G. Summary of Piloted Tests Results 

For compactness, not all results of the piloted tests are illustrated in this section. Therefore, a summary of the 
whole piloted tests analyses is presented as follows. The summary is based on analyses with respect to ten sub- 
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metrics: GSE, TDE (in X direction), CHR on GS (CHRGS), CHR on TD (CHRTD), TLX, integrated PSD of the roll 
stick (IPSDRS), pitch stick (IPSDPS) and rudder pedal (IPSDRP), and the frequencies of the highest PSD peak of 
the roll stick (FPSDRS) and pitch stick (FPS 

1) In general, inserting artificial time 
delay increased mean measures in 
all sub-metrics. However, the 
increase is not obvious for short 
delay cases in terms of most sub- 
metrics (Figure 8 shows one 
example). 

2) The time delay tends to move the 
highest PSD peak to higher 
frequency, and longer delay 
produced larger movement, 
whereas the compensation moves 
the highest PSD peak back to 
lower frequency, and the 
movement is slightly more obvious 
with the two novel predictors than 
with the MF. These results agree 
with the preliminary tests". 

3) On average, the delay increases the 
integrated PSD in the frequency 
interval from 0.022 to 0.614 Hz for Fig. 8. Mean value & STD of the integrated PSD changing with 
the straight-in approach, and the the time delay 

interval is from 0.08 to 0.528 Hz 

for the offset approach. On the other hand, the compensation decreases the integrated PSD in the interval 
from 0.068 to 0.559 Hz for the straight-in approach, and from 0.078 to 0.524 Hz for the offset approach. 
The effective intervals for the offset approach are narrower than those of the straight-in approach. In 
addition, the SS showed wider effective intervals than all other compensators. Both novel predictors 
showed slightly wider intervals than that of the MF. This is further evidence that the two novel predictors 
can achieve better compensation results than the McFarland predictor. 

4) The overall analyses based on all ten sub-metrics show that while the adaptive predictor results in slightly 
poorer compensation for short added delay and better compensation for long added delay than the 
McFarland compensator, the state space predictor is fairly superior for “short” delays and significantly 
superior for “long” delays to the McFarland compensator. The state space predictor also achieves better 
compensation than the adaptive predictor. The results of the evaluation on the effectiveness of these 
predictors in the piloted tests agree with those in the theoretical offline tests conducted with the recorded 
simulation aircraft states. 

5) Large variation in the STD in almost all sub-metrics might result either from different control strategies 
employed by different pilot subjects, or from the metrics being inconclusive. Figure 8 shows larger 
variation with the effect of the time delay. It indicates that for some pilots, the performance was even better 
with 192 ms added delay than without added delay. This demonstrates that the metrics used are not 
sufficiently effective. The variations with compensation are expected to be greater than those with the time 
delay, because no compensation can restore the system performance one hundred percent. 

VI. Conclusion 

The paper demonstrated mathematically why the stochastic approximation algorithm achieves the best 
compensation results among all the adaptive predictors using the asymptotic ODE of the stochastic approximation 
algorithm. The relationship between the reference model and the state space compensator performance was 
investigated in great detail, showing that the bandwidth of the reference model plays a key role in deciding the 
compensation quality of the state space predictor. The baseline visual image delay was measured to be 90 ms. 

Piloted simulation tests were conducted for assessing the effectiveness of the two novel compensators in 
comparison to the McFarland predictor and no compensation. Thirteen pilots with heterogeneous flight experience 
executed straight-in and offset approaches, at various delay configurations, on a flight simulator where different 
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predictors were applied to compensate for transport delay. Four metrics — the glide slope and touchdown errors, 
power spectral density of the pilot control inputs, NASA Task Load Index, and Cooper-Harper rating on the 
handling qualities were employed for the analyses. The overall analyses show that while the adaptive predictor 
results in slightly poorer compensation for short added delay and better compensation for long added delay than the 
McFarland compensator, the state space predictor is fairly superior for short delay and significantly superior for long 
delay to the McFarland compensator. The state space predictor also achieves better compensation than the adaptive 
predictor. The results of the evaluation on the effectiveness of these predictors in the piloted tests agree with those in 
the theoretical offline tests conducted with the recorded simulation aircraft states. 
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